Skip to content

ADFA-1807 | Add actionable feedback for local model load failures - #52

Open
jatezzz wants to merge 1 commit into
mainfrom
feature/ADFA-1807-model-load-error-feedback
Open

ADFA-1807 | Add actionable feedback for local model load failures#52
jatezzz wants to merge 1 commit into
mainfrom
feature/ADFA-1807-model-load-error-feedback

Conversation

@jatezzz

@jatezzz jatezzz commented Jul 28, 2026

Copy link
Copy Markdown
Contributor

Description

Added diagnostic classes (ModelLoadDiagnostics, ModelLoadMessages) to inspect .gguf files and memory states. This provides accurate, user-friendly error messages when local AI models fail to load, greatly improving the AI assistant's user experience.

Details

  • Extracted and added GgufFileInspector to validate file headers efficiently.
  • Implemented ModelLoadDiagnostics to categorize specific load errors (e.g., Low Memory, Not GGUF, File Missing).
  • Refactored LocalLlmBackend to utilize the new diagnostic tools and fail gracefully.
  • Included comprehensive unit tests for all new diagnostic and utility classes.
document_5136658230339965297.mp4

Ticket

ADFA-1807

Observation

Logic was deliberately split into pure functions/objects without Android Context where possible to ensure the diagnostic behavior remains fully unit-testable off-device. Teardown logic in LocalLlmBackend was also moved to a dedicated SupervisorJob to prevent orphan jobs.

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This repository is configured for manual code reviews. Comment @claude review for a one-time review, or @claude review always to subscribe this PR to a review on every future push.

Tip: disable this comment in your organization's Code Review settings.

@jatezzz
jatezzz force-pushed the feature/ADFA-1807-model-load-error-feedback branch 4 times, most recently from 017080b to 027918d Compare July 30, 2026 16:48
@hal-eisen-adfa

Copy link
Copy Markdown
Contributor

We should test this with a larger model

@jatezzz
jatezzz force-pushed the feature/ADFA-1807-model-load-error-feedback branch from 027918d to 19db609 Compare July 31, 2026 15:26
Refactors model loading to diagnose errors (e.g., low memory, invalid format) and provide clear, user-facing messages.
@jatezzz
jatezzz force-pushed the feature/ADFA-1807-model-load-error-feedback branch from 19db609 to c2ac2eb Compare July 31, 2026 15:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants